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PATEm* COOPERATION TREATY 

PCT 




INTERNATIONAL SEARCH REPORT 

(PCT Article 18 and Rules 43 and 44) 



Appflcanf 8 or agenfs file reference 
001/01103 


FOR FURTHER ^ Notffloatlon of Transmmal of IntemaUonal Search Report 
. ^ ^ . (F=6rm PCT/ISA/220) as wen as, whore appflcable. Item 5 below. 
ACTION 


International application No. 
PCT/IL 99/00490 


International filing date (day/month/^aar) 
08/09/1999 


(EaillesQ Pflortty Date (day/monWyear) 


Applicant 

3DV SYSTEMS, LTD. et al . 



IHs Intennatlonal Search Report has been prepared by this International Searching Authorfly and Is tranemltled to the appOcant 
according to Article 18. A copy Is being transmitted to the Intanriatfcmal Bureau 

This Intennatlonal Search Report consists of a total of __2 sheets. 

|X| It Is also accompanied by a copy of each prior art document cited In this report 



Bflwis of the report 

a. With regard to the language, the International search wascanied out on ttie basis of ttie international application In the 
language hi which It was filed, unless othenwlse Indicated under this Hem. 

I I the International search was canted out on the basis of a translation of the International application lUmlshed to this 
' Authority (Rule 23.1 (b)). 

b. With regard to any nucleotide and/or amino acid eaquenoe disclosed In ttte International application, ttie Intsmatlonal search 
was carried out on the basis of the sequence listing : 

I I contained In the International application m written form. 

tiled together with the hntematlonal appHcaUon In computer readable fonn. 
furnished subsequently to this AuttKN% In written torn, 
furnished subsequently to this Authority In computer readt>le form. 



□ 
□ 
□ 
□ 

□ 



the statement that the subsequently fUmlshed written sequence listing does not go beyond the disclosure In the 
International application as filed has been furnished. 

ttie statement ttiat the Infbnnatlon recorded In computer readable form Is Identical to ttie written sequence listing has been 
furnished 



2. 

a 



|~| Certain 
|~| Unltyof 



were found uneeareliable (See Box 1). 
le lacking (eee Box II). 



4. With regard to the title, 

Pn the text Is approved as submitted by the applicant 

n the text has been established by this Authoitty to read as follows: 



5. WHhreganjtothe< 

|X) ttie toxt Is approved as submitted by the appflcaiTt 

□ the text has been established, acoordlng to Rule 38.2(b), by this Authority as It appears In Box III. The appDcant may, 
wtttiln one month from the date of maOInqg of this international search report, submit comments to this Authority. 

a The figure of the dratwlngs to be publlstied with the abstract Is Hgure No. 2a 

fXI as suggested by ttie applicant None of ttie figures. 

I I because the applicant taOed to suggest a figure. 

I I because this figure better Gtiaractertzee ttie Invention. 
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WPOnrANTMCmHCATlON 




3DV SYSTEMS. LTD. et al. 





Intematlona! prefaminaiy axamination report and its anraxes. If Bry. established on the intemalional appUcafaon. 
^' to1?ttblte!t3offl?S "° """"^ being transmJttBdtoihe Intemaiional Bureau for communication 

^' !^®/!f3"'l??^ ^'^^ Intemaiional Bureau wOl prepare an EngliGh translation of the 

report OJUtncrt of any annexes) and vrtllransrnit such translatten 10 those Offli^ vansiaron ot we 

4. REMINDER 

r'®^'S^"*J]I"**^'^^>*' "^^'^^ »*«»***ore each elecW Offloe iv performing certain acts 
toBns^na and ^ng national fees) within 30 months from the priority date (or lat^In some OlliMS(Artide 
39(1)) (see alao the reminder aent fciy the Intemaiional Bureau wHh Foltn PCT/IB«01) ' 

Hl!!!^ ^J^^ international application must be furnished to an elected Office, that translation must i 

^ fhS^^"" *^ any annexes toihe intemationai preliminary examlnallan .aport It is the applSJs • 
responslbiUly fo prepare and fumiah sueh Iranslaiion directly to each eieeled Offioeconeemed 

I 

TOrJ^^li^ oSldJl^ applicable time limits and requiremenda of the elected Offloes. see Volume II of the 
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PATENT COOPERATION T^^TY 

PCT * 

INTERNATIONAL PREUMINARY EXAMINATION REPORT 

(PCT Article 36 and Rule 70) 



Applicsinfs or ogenfa US 
001/01103 



FOR PUfrmBR ACTION MMndt^ Exmhaadon Repon (Feim PCT/IPEA/41 6) 



tntBmfltfofiB] oppBirntfgfi No. 
PCT/ILOS|/D0490 



Oa/M/1999 



Priori^ date dJa^tnonAi/jfBBi) 
08/00/1899 



IntomalienBl Pstam Oas^Bcatien (IPC) of 
G0lSl7/Qe 



iNlcfiitonantf IPC 



Applicant • 

3DV SYSiTEMS. LTD. 01 at. 



1 . This intomalbnal prelimtnary oxamlnatbn rapoit has been pi^parad by title InbamaUonal PieRminary Exaintnlng Authority 
and b tranemllted tD the applk^m eeeofdhfl to 

2. This RSPCRT consists of a total of 10 aheeta. Including this cover sheet 

B This report Is also aoxifRpanied by ANNEXES, le. sheets of the descriptioi^ dalms ortd/or drawings which have 
been amondad and are the basis for thb report and/or sheets containing ractifiBafions made before thfa Authoifty 
(soe Rule 70.1 6 and Section 607 of the Admlnis«raiiH^ InstmctianB underthe PCT). 

These annexes oorislsr of a total of tfsheeikB. 



3. This report nntalne indications relaifriB to the follovi'ing items: 



Basis of the report 
Priority 

Non-establishment ef oplnloi^ with negord to imvaHy, | 
LaoK of unRy of frivonlton 

f^eesonad statamant under Altlde 35(2) with regaid t 
citations and expianaitians ai^or^frig euch statament 
Certain documents cted 



1 




II 


□ 


III 


• o 


IV 


a 


V 




VI 


□ 


VII 


B 


VIII 


! □ 



Oats of submission of ilie dsmsrtd 
16/08/2000 



iNlarrw and mailing address of tf^olnwrailena) 
preliminary examinine aiithoifty: 

Eur^ean Palsnt OHieo 
0-80298 Munich 

tel. ^8 88 2399-0 Ttc; fiaSBSS ^mu d 
Fex: 446 aa - 4465 



Date of eomple^n of this report 

iojos;aooi 



Auffiortzsd offiosr 
Westholm, U 

Tai0phoneNo.449892399a414 




F=enn PCT/IPEA/409 (ccrvorshesi) (Januaiy leal) 



ii^rmational prSdnary 
exami^tion report 



L Baste of the tepoit 

1. WHh rsganl tolhB etaments oTIhe intemafonal swlioatlon {Reoiae^nt .»^. ^ 

andajnotannexBdto this tgppnsinee tt^db /wfcST^n^/SSl^ 'ortffinatly etea" 

Deaer^ition, pages: «w onntam amemSmem (Rules 70. 16 and 70. 17)y. 



1-17 ! 

t 

Cbbn8.No.: 

7-34 ; 

1-e 

I 

DrBWings, sheete; 

1/5;2/5.4/5.S« 
3/S 



as origlnaHy filed 

asraeetvedon 
asreoelvBdon 



as orfginally filed 
aereo^vedon 



18/06/2000 with letter of 
2CI^M«2001 with tetter Of 



16^08^0 
18AM/!Z001 



2<W04/a)Oi witftletterof 



18/104/2001 



With re^ to the languege, aJI the elements majfced above were avaJlahk. v. ^ 

language m which the fnterr^tlonal application was f^^^^i::^^:^^^:^^;^'^ the 

These elements we« available or funil^ed to this Authoriijr in the ft^ng language: , which Is: 

^janguageofaijanslatlonfuni^ 

the language of publication of the International appIteaHon (under Rule 48 aft,,) ^ ^ 

the lai^uage of a translation furnished Ibr the duidosm «f . ' « . 

SS^andferSS^). '^^'^ P^Bmlneiy ««mlnatlo^ 

3. y'''**i'»0an6l to arqrnue|eofictearid/br amino add eeo»iBnA*i<i«j ^ . 
intemattenal preliminary examination was SiS o^XSS^^'C^S^^^ 



□ 
□ 
□ 



O contained In the International appllcaiion In written fami. 

filed together wfth the intemaBonal application In computer readable form 
lumtehed subsequent!/ to this Authorf^ In wrttten form. 

furnished subsequently to this Authority in computer .^dable fbrm 
r^^iTe'i'^;:r^ 



□ 

□ 
□ 
□ 



in 



fCTAPBA/ACB (BoNvs l-VIII, sheet 1) (Jb^ 1898) 



INTERNATIONAL PR^^INARY ^ 

EXAMINATION REPORT Intemgtlonal appecaUon No . PCT/IL99/00490 

4. The amendmente have resulted in the caneellafon 

n the description, pages: 
Q the claims, Nos. ; 

□ thp drawings, sheets: 

5. □ ms report has been established as if (some of) the amendments had not been made, sinoe they have been 

considered to go beyond the dl&dosure as Hied (Rule 70^(c)}: 

(Any i^ilacement sheet oemtahrhg such sm 1 smexed to thh 

report) 

6. Additional observalions, if neoessdiry: 



IV. Lackof unity of frivention 

1. In response to the frivitation to restrict or pay addffonalfte the appllcarithaB^ 

□ restrfcted the claims. 
B paid addltiona] fees. 

□ paid additional fees under protest 

□ neither rsstricted nor paid additional fees. 

2. D TWb Authority found that the requlremem of unity of Invention is not 

68:i, notto invite the applicant to restrict or pay additional fees. eocoroing to Rule 

s. This Authority considers that the requirement of unHy of invention in accordance With Rules 13.1 , 1 3,2 and 13.3 is 

□ complied with. 

□ not ooniplied with for the follovtfing reasons: 
la all parts. 

□ the parts relating to daime Nos. . 

V, RMsoiied etafemem under Article 3S{2> with regaid to novelty, inventive elep or Indueiriai eppflcal»iiitv 
eltatfoife end eaqalanatlons supportinQ eueh etetement ui«uwnBii appiicaoiiity , 

1. Statement 



Fomi PCT/IPep/40g (Boxes ^vm. She« ^ (Juty 1 99B) 



INTERNATIONAL PR^HNARY 
EXAMINATION REPORT 



Internatfonal ^yncaBon No. PCT/ILS9/00490 



Novelty (N) 


Yes: 


Clabns 


1-34 




No: 


Claims 




inventive step (IS) 


Yes: 


Claims 


1^ 




No: 


Claims 




Industrial applicoblUt/ (lA) 


Yes; 


Claims 






No: 


Claims 





2. Citations and explanations 
see separate sheet 

VIL Certain deHeots bi the international appIioQtion 

ThefcUowing defedfi in the farm or oontenia of the Intemafional appUcaiion hawe been noted: 
see separate sheet 



Form PcnyiPEA/409 (Bcac9S l-vm. Shoot 3) (July T608) 



1 . riefarenoB Is made to the following documents (numbering acconiing to the order 
In the search report); 

D1: US-A-5 434 612 (NETTLETON JOHN E ETAL) 18 July 1995 (1995-07-18) 
cited In the appOcation 

P2: EP-A-O 777 1 34 (YALESTOWN CORP N V) 4 June 1 997 (1 997-06-04) 

D3: WO 95 30928 A (IMAGE TECHNOLOGY INTO 16 Novemberl 995 (1995-11- 
16) 



2. The appncaHon lacks unify within the meaning of Rule 1 3 PCT for the fotlowlna 
reasons: 

2.1 . the applicaUon contains the following Independent claims for devices and 
methods: 

a) Claim 1 relating to an Imaging system with, among othere, a light control system 
that controls an amount of light from the taking lens that reaches the 3D camera 
and the Imaging camera Independently of each other. 

b) Qai m 29 relating to a gated 3D camera with, among others, at least 2 
photosurfaces. 

I 

2.2. The only matter common to the two Independent claims is: 

a KaMng lens system that oolleds Dght from a scene being Imaged with the optical 
Imaging system; 

Systems with these features are well known, see for example Di . 

The matter common to all the Independent claims is thus not novel and does 
therefore not constitute a general Invenfh^e concept (see PCT GuideHnes, III, 7.6). 

2.3. T?je remaining subject matter of the independent claims is: 



Perm PCT/SaparatB ShaoMod (Sheet 1) (S>O^Api0 1897) 



Claim 1 : 

An optical Imaging sysbBm comprising: 

^3D camera comprising at least one photcsurfece that recelvas light from the 
taking lens system simultaneously from all points in the scene and provides data 
for generating a depth map of the scene responsive to the nght; and 
an .m^lng camera eomprislng at least one photosurfeoe that receives light from 
ttje taking lens system and provides a picture of the scene responsive to the fight; 

I 

aiOght control system that controls an amount of fight from the taking lens that 
reaches the 3D camera and the Imaging camera Independently of each other. 

Claim 29: 

A:gated 3D camera comprising: 

a Rght guide that recent Oght from the taking lens and directs portions of the fight 
thfeit It receh.es to each of the at least two pholosurl^; ^ 
a single shutter, which when gated open enables light fiim the taking lens system 
tojreach the fight guide; and ^ ^^"^ 

a controller that controls the shutter and the photosurfaoes and gates on a 
ph-otosurfaoB of the at least two photosurfaoes by activating the photosurface and 
subsequen^galing the single shutter open and gates off the photosurface by 
g^ng the single shutter closed and subsequently deactivating the photosurlie 
ana wherein the oontnsller gates on only one photosurface at a time. 

2.4. imesB remaining fealures solve pn>blems that are oleariy not related to each 

other. 

Thereis therefore no unliying concept common to the remaining subject-matter of 
the^twomdependent claims. aueror 

The remaining subject-matter of the two Independent claims does therefore not 
constitute a general Inventive concept (see PCT GuideBnes, III, 7.6). 

2.5. It is: therefore considered that the appflcation contains the following groups of 
that the appncaHon therefore lacks unity within the meaning of Rule 13 PCT (see 



Form PCT/SeparatB $h9ot/4od (8hoet 2) (EPO-Apri 1957) 
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Ion No. POT/IL99/004dO 



also PCT Guidelines C-lll, 7.6): 
Group 1: 

Claims 1-28 relating to an Imaging system with, among others, a fight control 
system tti^ controls an amount of Rght from the taking lens that reaches the 3D 
camera independently of an amount of light from the taking lens that maches the 
imaging camera. 

Caroup 2: 

Clalms ^34 relating to a gated 3D camera with, among others, at least 2 
photosurfeces. 



3. TTie following objeotiona, of formal nature, are islsed. 

Rute 6,3(b) PCT is not met, since the Independent claims are not In the two^rt 

If. however, the applicant Is of the opinion that the two-part form would be 
inappropriate^ then reasons therefor should be provided in the letter of reply. In 
ad^on, the applicant should ensure that it is clear from the description which 

fdaiures of the subject-matter of claims t and 29 are already known In' 
combinafion from the document Dl (see the PCT Quidefines. III-2.3a). 

Rule 6.2(b) PCT Is not met. since reference signs a,^ missing In the claims. TTiis 
appOes to both the preamble and the characterising portion. 

4. Claims 1-34 are considered to ftilfll the requirements of Article 33 PCT. 
4.1. Claim 1: 



The closest prior art document Is considered to be D1 . 



I 



Fbrm PCT/Saparate She«t/4O0 (Sheet 3) iS»O^Apt^ tag?) 



jNATION REPORT- SEPARATE ^^^ ^'^^^^ No, PCT/IL99«)04S0 

: 

p1 discloses 

An optical Imaging system comprising: 

a SD camera comprising at laast one photosurtace that receives fight from the 
taking feiw system sTmultaneousfy fram an points in the scene and provides data 
nar generating a depth map of the scene responsive to the light, 

the claimed system differs from this prior art by the following features- 

^ .maglng camera comprising at least one photosurfaoe that receives fight from 

ttie taMno lens system and provides a picture of the scene responsive toVe Og^ 

al nght control system that controls an amount of nght from the taking lens that 
reaches the 3D camera and the imaging camera independently of each other 

TfxesB dlffejenoas result In a system that combines a 3D camera and an imaging 
camera with only one taking lens. >««n imaging 

TTie problem to be solved by the im^entlon Is therefbi^ to simplily the optical 
system of D1 . 

It ?s not obvious to solve this problem with the futures (a) and (b) mentioned 
aoove* 



(a) 
(b) 



Npne of ttie documents cited in the International Search Report discloses the 

^^^7^ ^ «>mWn^on of an imaging camem and a 3D camera, but with 
t^Te^Z^J^T'^^ documents cited In the International Search 
R^ort do not disclose the comblnaaon of an imaging camera and a 3D camera at 

I 

^ '^''^ ^ ""^'"S comprising a 3D 

^meracombmed With an imaging camera. Illumlnafion of ascene for imaging 
w,<h a 3D camera ,s generally quite different from illumination of a scenefor 



f=bmi PCT/Separato Shaetf409 (ShMft4) (EPO^iff 1997) 



Imaging with an imaging camera. As a r^ult Dght gathering capacity required of a 
taking lens used with a 3D camera Is generally different from flght gathering 
capacity required of a talgng lens used with an Imaging camera. There is usually 
ample right available for imaging a scene with an imaging camera. On the other 
hand a quantity of light available for imaging with a 3D camera is generally small 
For example. Hght for imaging a scene using a 3D camera is often suppSed by a 
laser. For pracfical and safety reasons the output power of the laser is usually 
lonited- As a result, a taWng lens used with a 3D camera that images a scene 
must generally be set to a substantially lower f-number than an f-number setting 
for a taking lens used with an imaging camera that images the scene. Hie 
aniagonistio f-number requirements of a 3D camera and an Imaging camera teach 
away from using a single taking lens for both a 3D camera and an imaging 
canridra. 

Claim 1 resolves the antagonism by the limitaflon of "a Bght control system that 
controls an amount of fight from the taking lens thai reaches the 3D camera and 
the imaging camera independently of each other-. None of the documents cited in 
the International Search Report discloses this feature. 

4.2. Claim 29: 

The closest prior art document is considered to tie' Dl . 
Dl discloses 

aigated 3D camera comprising; 

a taking lens system that coHects Hght from a scene imaged with the 3D camera: 
at least 2 photosurfaces; 

a light guide that receh^s Hght from the taking lens and directs portions of the flght 
that It receh/es to each of the at least two photosurfaces. 

The claimed device differs from this prior art by the fbllowlng f^res- 

(a) a single shutter, which when gated open enables fight from the taking lens system 
to. reach the light guide; and 

(b) a controller that controls the shutter and the photosurfaces and gates on a 
photosurface of the at least two photosurfaces by activating the photosurface and 
subsequently gating the single shutter open and gates off ttie photosurface by 



FennPCfT7SeparateShMtr«)»(Slwats)(EPO.^ 1897) 
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j 

I 
I 

g^ng the single shuter dosed and subsequently deactivating the photosurface 
a^d wherein the oontrolier gates on on(y one photosurface at a time. 

I 

virtth these distinguishing features, the claimed device can uso one single shutter 
for fast gating of ok least two photosurfaces subsequently. These differences do 
thus result In a device in which the advantages of a device wrth one shutter per 
photosurfaoe are obtained without the construcUonai complexity of physically 
pjoviding one shutter fbr each photosurface. 

The problem to be solved by the invention Is therefore to slmpDty the device of D1 . 

I 

It fla not obvious to solve this problem with the features (a) and (b) mentioned 
above. 

None of the documents cited in the Intemafional Search Report discloses the use 

ofj one single shutter for subsequent gating of at least two photosurfaces. 

D9 (page 12-14 and figures 9-11) discloses a camera In which one single shutter 

ls:u8ed for gating of three photosurfaces (feature "(a)"). The gating Is however not 

perfonned for one photosurface at a time, but simultaneously for all the 

photosurfisces. 

The other documents dted In the International Search Report do not disclose 
sharing of a single shutter between several photosurfaces at all. 



Fomi PCTiBspanne Sheetr4e8 (Sh««t 6) (BPO'April 18B7) 
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15 



20 



CLAIMS 



ixaa^Dgsysbmi 

to fi3«ten rimullaieouBbr flom all pcrints in file «^ 
deptbiDHp of the sceaie lesponsiv© to the fi^l; ajid 

an imagii^ camera coji^daiig at least ^ 
taking 1«B 8>«i«ii atidiTOvite apictare of ti» 8c^ 
; »fiS**«ai«»l«5«temaiat«iirtm^ 

8tI«wton«oftJ,e3Dcam«aand&«imafifagcamem ^WaflfecttogattaBOOttttofH^fl^ 
reacJwa th& other of the 3D «m«*a and the iniaging 



2. : An optical naaging system accoidias to dana 1 wtetia 4>e 3D camoa and tbc 
mafiiBgeamicra are borestf^hlEd with the taildi^ 

i 

3. All optical ftnagrngfiystaniaccoidme to 

phote^urfecc of the 3t» camera aad aie at leart one ptotosmfe^ 
llomoIo£;a^ul. 



4. 



:Ai» c^tical imaging accordii^ to any of tte 

««trrf system o^nprisea a 

fakmg^«issysrt«n that i^adhes the imaging cffl^ 
25 thes taking lens system that reaches ftfl 3D camera. ~ 



5. 

an Ms. 



|An c^ticaj imaging isystew acooidu^ to 
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INTERNATIONAL PRELIMINARY 
EXAMINATION REPORT 



International application No. PCT/IL99/00490 



I. Basis of the report « . ^ 

1 . With regard to the elements of the international application (Replacement sheets which have been furnished to 
the receiving Office in response to an invitation under Article 14 are referred to In this report as "originally filed" 
and are not annexed to this report since they do not contain amendments (Rules 70. 16 and 70. 17)): 
Description, pages: 

1-17 as originally filed 
Claims, No.: 

7-34 as received on 18/08/2000 with letter of 16/08/2000 

1-6 as received on 20/04/2001 with letter of 18/04/2001 

Drawings, sheets: 

1/5,2/5,4/5,5/5 as originally filed 

3/5 as received on 20/04/2001 with letter of 18/04/2001 

2. With regard to the language, all the elements marked above were available or furnished to this Authority in the 
language in which the international application was filed, unless otherwise indicated under this item. 

These elements were available or fumished to this Authority in the following language: , which is: 

□ the language of a translation fumished for the purposes of the international search (under Rule 23.1 (b)). 

□ the language of publication of the international application (under Rule 48.3(b)). 

□ the language of a translation fumished for the purposes of international preliminary examination (under Rule 
55.2 and/or 55.3). 

3. With regard to any nucleotide and/or amino acid sequence disclosed in the international application, the 
international preliminary examination was carried out on the basis of the sequence listing: 

□ contained in the international application in written fomri. 

□ filed together with the intemational application in computer readable form. 

□ fumished subsequently to this Authority in written form. 

□ fumished subsequently to this Authority in computer readable form. 

□ The statement that the subsequently furnished written sequence listing does not go beyond the disclosure in 
the intemational application as filed has been furnished. 

□ The statement that the infomriation recorded in computer readable form is identical to the written sequence 
listing has been fumished. 
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4. 



The amendments have resulted in the cancellation of: 



□ 
□ 



the description, 
the claims, 
the drawings, 



pages: 
Nos.: 



□ 



sheets: 



5. □ This report has been established as if (some of) the amendments had not been made, since they have been 

considered to go beyond the disclosure as filed (Rule 70.2(c)): 

(Any replacement sheet containing sucii amendments must be referred to under item 1 and annexed to Uiis 
report.) 

6. Additional observations, if necessary: 
iV. Lack of unity of invention 

1 . In response to the invitation to restrict or pay additional fees the applicant has: 

□ restricted the claims. 
IS paid additional fees. 

□ paid additional fees under protest. 

□ neither restricted nor paid additional fees, 

2. □ This Authority found that the requirement of unity of invention is not complied and chose, according to Rule 

68.1 , not to invite the applicant to resthct or pay additional fees. 

3. This Authority considers that the requirement of unity of invention in accordance with Rules 13.1, 13.2 and 13.3 is 

□ complied with. 

□ not complied with for the following reasons: 

4. Consequently, the following parts of the international application were the subject of international preliminary 
examination in establishing this report: 

IS ail parts. 

□ the parts relating to claims Nos. . 

V. Reasoned statement under Article 35(2) with regard to novelty, inventive step or industrial applicability; 
citations and explanations supporting such statement 

1. Statement 
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Novelty (N) 



Yes: Claims i t-34 
No: Claims 



Inventive step (IS) 



Yes: 
No: 



Claims 
Claims 



1-34 



Industrial applicability (lA) Yes: Claims 

No: Claims 



1-34 



2. Citations and explanations 
see separate sheet 



VII. Certain defects in the international application 

The following defects in the fomn or contents of the international application have been noted: 
see separate sheet 
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1 . Reference Is made to the following documents (numbering according to the order 
in the search report): 

D1 : US-A-5 434 612 (NETTLETON JOHN E ET AL) 18 July 1995 (1995-07-18) 

cited in the application 
D2: EP-A-0 777 1 34 (YALESTOWN CORP N V) 4 June 1 997 (1 997-06-04) 
D3: WO 95 30928 A (IMAGE TECHNOLOGY INT) 1 6 November 1 995 (1 995-1 1 - 

16) 

2. The application lacks unity within the meaning of Rule 13 PCT for the following 
reasons: 

2.1 . The application contains the following independent claims for devices and 
methods: 

a) Claim 1 relating to an imaging system with, among others, a light control system 
that controls an amount of light from the taking lens that reaches the 3D camera 
and the imaging camera independently of each other. 

b) Claim 29 relating to a gated 3D camera with, among others, at least 2 
photosurfaces. 

2.2. The only matter common to the two independent claims is: 

a taking lens system that collects light from a scene being imaged with the optical 
imaging system; 

Systems with these features are well known, see for example D1 . 

The matter common to all the independent claims is thus not novel and does 
therefore not constitute a general inventive concept (see PCT Guidelines, III, 7.6). 

2.3. The remaining subject matter of the independent claims is: 
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Clainni: 

An optical imaging system comprising: 

a 3D camera comprising at least one photosurface that receives light from the 

taking lens system simultaneously from all points in the scene and provides data 

for generating a depth map of the scene responsive to the light; and 

an imaging camera comprising at least one photosurface that receives light from 

the taking lens system and provides a picture of the scene responsive to the light; 

and 

a light control system that controls an amount of light from the taking lens that 
reaches the 3D camera and the imaging camera independently of each other. 

Claim 29: 

A gated 3D camera comprising: 

a light guide that receives light from the taking lens and directs portions of the light 
that it receives to each of the at least two photosurfaces; 

a single shutter, which when gated open enables light from the taking lens system 
to reach the light guide; and 

a controller that controls the shutter and the photosurfaces and gates on a 
photosurface of the at least two photosurfaces by activating the photosurface and 
subsequently gating the single shutter open and gates off the photosurface by 
gating the single shutter closed and subsequently deactivating the photosurface 
and wherein the controller gates on only one photosurface at a time. 

2.4. These remaining features solve problems that are clearly not related to each 
other. 

There is therefore no unifying concept common to the remaining subject-matter of 
the two independent claims. 

The remaining subject-matter of the two independent claims does therefore not 
constitute a general inventive concept (see PCT Guidelines, III, 7.6). 

2.5. It is therefore considered that the application contains the following groups of 
systems, that are not linked to each other by any single inventive concept, and 
that the application therefore lacks unity within the meaning of Rule 13 PCT (see 
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also PCT Guidelines C-lll, 7.6): ' 
Group 1 : 

Claims 1-28 relating to an imaging system with, among others, a light control 
system that controls an amount of light from the taking lens that reaches the 3D 
camera independently of an amount of light from the taking lens that reaches the 
imaging camera. 

Group 2: 

Claims 29-34 relating to a gated 3D camera with, among others, at least 2 
photosurfaces. 

3. The following objections, of formal nature, are raised. 

Rule 6.3(b) PCT is not met, since the independent claims are not in the two-part 
form. 

If, however, the applicant is of the opinion that the two-part form would be 
inappropriate, then reasons therefor should be provided in the letter of reply. In 
addition, the applicant should ensure that it is clear from the description which 
features of the subject-matter of claims 1 and 29 are already known in 
combination from the document D1 (see the PCT Guidelines, lll-2.3a). 

Rule 6.2(b) PCT is not met, since reference signs are missing in the claims. This 
applies to both the preamble and the characterising portion. 

4. Claims 1 -34 are considered to fulfil the requirements of Article 33 PCT. 
4.1. Claim 1: 

The closest prior art document is considered to be D1 . 
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D1 discloses 

An optical imaging system comprising: 

a taking lens system that collects light from a scene being imaged with the optical 
imaging system; 

a 3D camera comprising at least one photosurface that receives light from the 
taking lens system simultaneously from all points in the scene and provides data 
for generating a depth map of the scene responsive to the light. 

The claimed system differs from this prior art by the following features: 

(a) an imaging camera comprising at least one photosurface that receives light from 
the taking lens system and provides a picture of the scene responsive to the light; 
and 

(b) a light control system that controls an amount of light from the taking lens that 
reaches the 3D camera and the imaging camera independently of each other 

These differences result in a system that combines a 3D camera and an imaging 
camera with only one taking lens. 

The problem to be solved by the invention is therefore to simplify the optical 
system of D1. 

It is not obvious to solve this problem with the features (a) and (b) mentioned 
above. 

None of the documents cited in the International Search Report discloses the 
combination of an imaging camera and a 3D camera using a same single taking 
lens for both cameras. 

D2 discloses a combination of an imaging camera and a 3D camera, but with 
different taking lenses. The other documents cited in the International Search 
Report do not disclose the combination of an imaging camera and a 3D camera at 
all. 

It is not obvious to use a single taking lens for an imaging system comprising a 3D 
camera combined with an imaging camera. Illumination of a scene for imaging 
with a 3D camera is generally quite different from illumination of a scene for 
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imaging with an imaging camerk As a result, light gathering capacity required of a 
taking lens used with a 3D camera is generally different from light gathering 
capacity required of a taking lens used with an imaging camera. There is usually 
ample light available for imaging a scene with an imaging camera. On the other 
hand a quantity of light available for imaging with a 3D camera is generally small. 
For example, light for imaging a scene using a 3D camera is often supplied by a 
laser. For practical and safety reasons the output power of the laser is usually 
limited. As a result, a taking lens used with a 3D camera that images a scene 
must generally be set to a substantially lower f-number than an f-number setting 
for a taking lens used with an imaging camera that images the scene. The 
antagonistic f-number requirements of a 3D camera and an imaging camera teach 
away from using a single taking lens for both a 3D camera and an imaging 
camera. 

Claim 1 resolves the antagonism by the limitation of "a light control system that 
controls an amount of light from the taking lens that reaches the 3D camera and 
the imaging camera independently of each other". None of the documents cited in 
the International Search Report discloses this feature. 

4.2. Claim 29: 

The closest prior art document is considered to be D1 . 

D1 discloses 

a gated 3D camera comprising: 

a taking lens system that collects light from a scene imaged with the 3D camera; 
at least 2 photosurfaces; 

a light guide that receives light from the taking lens and directs portions of the light 
that it receives to each of the at least two photosurfaces. 

The claimed device differs from this prior art by the following features: 

(a) a single shutter, which when gated open enables light from the taking lens system 
to reach the light guide; and 

(b) a controller that controls the shutter and the photosurfaces and gates on a 
photosurface of the at least two photosurfaces by activating the photosurface and 
subsequently gating the single shutter open and gates off the photosurface by 
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gating the single shutter closed'and subsequently deactivating the photosurface 
and wherein the controller gates on only one photosurface at a time. 

With these distinguishing features, the claimed device can use one single shutter 
for fast gating of at least two photosurfaces subsequently. These differences do 
thus result in a device in which the advantages of a device with one shutter per 
photosurface are obtained without the constructional complexity of physically 
providing one shutter for each photosurface. 

The problem to be solved by the invention is therefore to simplify the device of D1 . 

It is not obvious to solve this problem with the features (a) and (b) mentioned 
above. 

None of the documents cited in the International Search Report discloses the use 

of one single shutter for subsequent gating of at least two photosurfaces. 

D3 (page 12-14 and figures 9-11) discloses a camera in which one single shutter 

is used for gating of three photosurfaces (feature "(a)"). The gating is however not 

performed for one photosurface at a time, but simultaneously for all the 

photosurfaces. 

The other documents cited in the Intemational Search Report do not disclose 
sharing of a single shutter between several photosurfaces at all. 
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^ (57) Abstract: An optical imaging system comprising: a taking lens system that collects light from a scene being imaged with the 
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Q ously from all points in die scene and provides data for generating a depth map of die scene responsive to the light; and an imaging 
^ camera comprising at least one photosurface diat iecei\'es light from the taking lens system and provides a picture of the scene re- 
^ sponsive to the light. 
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3D IMAGING SYSTEM 
FIELD OF THE INVENTION 



The invention relates to cameras that provide an image of a scene and measurements of 
distances to regions in the scene. 

BACKGROUND OF THE INVENTION 

3D cameras that provide distance measurements to objects and points on objects that 
they image are well known in the art. Gated 3D cameras comprise a photosensitive surface, 
such as a CCD or CMOS camera, hereinafter referred to as a "photosurface", and a gating 
means for gating the camera open and closed, such as an electro-optical shutter or a gated 
image intensifier. To image a scene and determine distances from the camera to objects in the 
scene, the scene is generally illuminated with a train of light pulses radiated from an 
appropriate light source. Generally, the radiated light pulses are infrared (IR) light pulses. For 
each radiated light pulse in the train, following an accurately determined delay from the time 
that the light pulse is radiated, the camera is gated open for a period of time, hereinafter 
referred to as a "gate". Light from the light pulse that is reflected from an object in the scene is 
imaged on the photosurface of the camera if it reaches the camera during the gate. Since the 
time elapsed between radiating a light pulse and the gate that follows it is known, the time it 
took imaged light to travel from the light source to the reflecting object in the scene and back 
to the camera is known. The time elapsed is used to determine the distance to the object. 

In some of these 3D cameras, only the timing between light pulses and gates is used to 
determine distance from the 3D camera to a region in the scene imaged on a pixel of the 
photosurface of the 3D camera. In others, the amount of light registered by the pixel during the 
time that the camera is gated open is also used to determine the distance. In 3D cameras in 
which the amount of light is used to detemiine distances to the imaged region, the amount of 
light registered on a pixel is sometimes corrected for reflectivity of the imaged region, dark 
current and backgroimd light. The accuracy of measurements made with these 3D cameras is a 
ftinction of the rise and fall times and jitter of the light pulses and their flatness, and how fast 
the gating means can gate the camera open and closed. 

Gated 3D cameras that determine distances to objects in a scene that they image 
responsive to amounts of light registered on pixels of photosurfaces comprised in the 3D 
cameras are described in PCT Pubhcations WO 97/01111, WO 97/01112, and WO 97/01113, 
the disclosures of which are incorporated herein by reference. 
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A gated 3D camera as shown in WO 97/01111 comprises first and second homologous 
photosurfaces and a light source that illuminates a scene being imaged with the camera with a 
train of, preferably IR, light pulses. The first photosurface, hereinafter referred to as a "distance 
photosurface", is gated on with a short gate following the time that each light pulse in the pulse 
5 train is radiated. The portion of light firom each light pulse in the pulse train that is reflected by 
a region of the scene and enters the 3D camera, which is registered on a pixel of the distance 
photosurface, is a function of the distance of the region fi^om the pixel. The second 
photosurface, hereinafter referred to as a "normaUzation photosurface", is preferably not gated. 
The portion of light fi-om each light pulse in the pulse train that is reflected by a region of the 
10 scene and enters the 3D camera, which is registered on a pixel of the normalization 
photosurface, is independent of the distance of the region from the pixel. The amount of light 
registered on the pixel is a measure of the total amount of light reaching the camera from the 
imaged region. An amount of reflected light registered on a pixel of the distance photosurface 
firom all the light pulses in the pulse train is normalized to an amount of reflected light from all 
15 the light pulses registered on a corresponding pixel in the normalization photosurface. 
Normalized amounts of Ught are used to detemiine distances to regions in the scene. 

US patent 5,434,612 to Nettleton, the disclosure of which is incorporated herein by 
reference, describes a gated 3D camera comprising first, second and third photosurfaces. A 
scene imaged with this camera is not illuminated with a train of light pulses but with a single 
20 light pulse from a laser and the three photosurfaces are gated with respect to the time that the 
light pulse is radiated. The first photosurface is a distance photosurface. It is gated with a short 
gate so that a portion of the light pulse reflected by a region of the scene that is collected by the 
camera and registered on a pixel of the photosurface is a fimction of the distance of the region 
from the pixel. The second photosurface is a normalization photosurface. It is gated with a long 
25 gate so that the amount of reflected laser light registered on a pixel of the photosurface from an 
imaged region is a measure of the total amoimt of Ught reaching the camera from the imaged 
region. The third photosurface is used to measure background light by measuring the amount of 
light reaching the camera in a band of wavelengths near to wavelengths of light radiated by the 
laser. A filter that transmits light in the band of wavelengths close to the wavelength of the 
30 laser light but blocks Ught having a wavelength the same as a wavelength of light radiated by 
the laser shields the third photosurface. The third photosurface is gated simultaneously with the 
normalization photosurface by a long gate having a same gate width as the gate that gates the 
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second photosurface. A photosurface used to measure background light is hereinafter referred 
to as a "background photosurface**. 

Amounts of light registered on the background photosurface are used to correct the 
amounts of light registered on pixels of the distance and normalization photosurfaces for 

5 background light. Background corrected amounts of light registered by pixels on the 
nomialization photosurface are used to normalize background corrected amounts of Ught 
registered by pixels on the distance photosurface. Distances to regions in the scene are 
determined from the backgroimd corrected normalized amoimts of light registered by pixels on 
the distance photosurface. 

10 Generally photosurfaces used in 3D cameras are gated by an external fast shutter. 

Certain types of CCD cameras allow for gating image acquisition on and off during a frame by 
turning the photosurfaces on and off. However, tum-on and tum-off times of these 
photosurfaces are generally much too long to enable gating the photosurfaces for the piuposes 
of accurate distance measurements by turning them on and off. Typically tum-on and tum-off 

15 times for CCD photosurfaces are on the order of microseconds while gating for accurate 
distance measurements requires tum-on and tum-off times on the order of nano-seconds or less. 
An electro-optical shutter suitable for use in 3D cameras, such as those described in the 
cited patent and patent applications is described in PCT Publication WO 99/40478, the 
disclosure of which is incorporated herein by reference. 

20 Generally, a 3D camera is used in conjunction with an imaging camera, such as a video 

camera, that provides an image, hereinafter referred to as a ''picture", of a scene being imaged 
with the 3D camera responsive to visible light from the scene. The 3D camera provides a 
•'depth map" of the scene while the imaging camera provides a picture of the scene. Distances 
provided by the depth map are associated with visible features in the picture. Li some 

25 applications distances associated with a picture of a scene are used to "window** the scene and 
remove unwanted features and/or objects in the scene, such as for example a background, from 
the picture- Such applications are described in PCT pubhcation in WO 97/01 111 cited above. 

PCT patent application PCT/IL98/00476, entitled "Distance Measurement with a 
Camera", by some of the same inventors as the inventors of the present invention, the 

30 disclosure of which is incorporated herein by reference, describes a photosurface comprising 
pixels each of which has its own circuit that is controllable to gate the pixel on or off. A single 
photosurface of this type is useable to simultaneously provide the fimctions of a distance, 
backgroimd and normalization photosurface of a 3D camera as well as an imaging camera. 
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However, as the number of functions that the photosurface performs increases, the resolution of 
the photosurface decreases. 

It is advantageous to have a simple robust optical system comprising a 3D camera and 
an imaging camera that is easily adjustable to simultaneously optimize quantities of light 
5 available from a scene imaged by the system that reach the cameras. 

SUMMARY OF THE INVENTION 
An aspect of some preferred embodiments of the present invention relates to providing 
an improved optical system, hereinafter referred to as a "3D imager", comprising a 3D camera 
and an imaging camera, for acquiring depth maps and pictures of a scene. 
10 An aspect of some preferred embodiments of the present invention relates to providing 

a 3D imager that is relatively easily adjusted so that its 3D and imaging cameras may 
simultaneously receive optimum amounts of light available from a scene being imaged with the 
3D imager. 

An aspect of some preferred embodiments of the present invention relates to providing 
15 a 3D imager comprising an improved gating system for gating photosurfaces comprised in its 
3D camera. 

A 3D imager, in accordance with some preferred embodiments of the present invention, 
comprises a single taking lens boresighted with a gated 3D camera and an imaging camera. 
Preferably, the imaging camera is a color camera. Preferably the 3D camera comprises three 

20 photosensitive surfaces, a distance photosurface, a normalization photosurface and a 
background photosurface. Preferably, the 3D imager is used with a pulsed IR light source that 
illuminates a scene being imaged with the 3D imager with a train of preferably IR, light pulses. 
Light from the light pulses reflected by objects in the scene is used by the 3D camera to 
provide a depth map of the scene. Visual light from the scene is used by the imaging camera to 

25 provide a picture of the scene 

While there is usually more than ample amount of visible light available to form a 
quality picture of the scene, the quantity of light available for the purpose of providing a depth 
map of the scene is usually small. As a result, the 3D imager usually requires that the taking 
lens be set to a much higher f-number to produce a quality picture of the scene than an f- 

30 number required to provide accurate distance measurements to the scene. 

To provide proper control of the amounts of hght reaching the 3D camera and the 
imaging camera, the 3D imager comprises a system that controls the amount of light reaching 
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the imaging camera from the taking lens independently of the amount of light reaching the 3D 
camera. 

Preferably, the 3D camera comprises at least two irises. A first iris of the at least two 
irises controls the amount of visible light collected by the taking lens that reaches the imaging 

5 camera. A second iris controls either the amount of IR light collected by the taking lens that 
reaches the 3D camera or the total amount of IR and visible light collected by the taking lens 
that enters the 3D imager. As a result, the 3D imager can be adjusted to control independently 
amounts of light reaching the imaging camera and the 3D camera from a scene being imaged 
with the 3D imager. Therefore, subject to a level of illumination of the scene, a 3D imager, in 

10 accordance with a preferred embodiment of the present invention, is adjustable to 
simultaneously optimize the amounts of light from the scene that reach its 3D and imaging 
cameras. 

In accordance with some prefen-ed embodiments of the present invention all 
photosurfaces comprised in the 3D camera are gated with a same single fast shutter. This 

15 substantially simplifies the construction and control of the 3D imager. Preferably the 3D 
camera comprises three photosurfaces, a distance photosurface, a background photosurface and 
a normalization photosurface. The three photosurfaces are independently controllable to be 
turned on and off Preferably, all light transmitted from the taking lens to the 3D camera passes 
through the single fast shutter. After passing through the shutter, portions of the light are 

20 directed to each of the three photosurfaces, for example by a prism. Preferably, the prism is a 
totally intemal reflection (TIR) prism. At any given time, to determine which of the 
photosurfaces is gated by the fast shutter, all photosurfaces except a photosurface that is to be 
gated by the fast shutter are shut off. 

It is to be noted that whereas the photosurfaces are controllable to be turned on or off, 

25 the speed with which a photosurface can be switched between on and off states is generally not 
fast enough to gate the photosurfaces for the purposes of accurate distance measurements. 
Therefore, for 3D cameras, gating photosurfaces by timiing them on and off is genemlly not 
practical. 

In some preferred embodiments of the present invention, the 3D camera and associated 
30 optical components are housed as a single unit, hereinafter referred to as a "3D module". The 
3D module comprises portals for optically coupling a taking lens and imaging camera to the 3D 
module using methods and techniques known in the art. In some preferred embodiments of the 
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present invention, the 3D camera, imaging camera and associated electrical and optical 
components are integrated together as a single imit to which a taking lens is optically coupled. 

There is therefore provided, in accordance with a preferred embodiment of the present 
invention an optical imaging system comprising: a taking lens system that collects light from a 
5 scene being imaged with the optical imaging system; a 3D camera comprising at least one 
photosurface that receives light from the taking lens system simultaneously from all points in 
the scene and provides data for generating a depth map of the scene responsive to the light; and 
an imaging camera comprising at least one photosurface that receives light from the taking lens 
system and provides a picture of the scene responsive to the light. 
10 Preferably, the 3D camera and the imaging camera are boresighted with the taking lens 

system. Additionally or altematively, the at least one photosurface of the 3D camera and the at 
least one photosurface of the imaging camera are preferably homologous. 

In some preferred embodiments of the present invention, an optical imaging system 
comprises a light controller adjustable to control the amount of light from the taking lens 
15 system that reaches the imaging camera without affecting the amount of light from the taking 
lens system that reaches the 3D camera. Preferably, the light controller comprises an iris. 
Altematively, the light controller preferably comprises a neutral density filter. 

In some preferred embodiments of the present invention, an optical imaging system 
comprises a light controller adjustable to control the amount of Ught collected by the taking 
20 lens system that enters the imaging system. Preferably, the light controller comprises an iris. 

In some preferred embodiments of the present invention, an optical imaging system 
comprises a light controller adjustable to control the amoxmt of light from the taking lens 
system that reaches the 3D camera without affecting the amount of hght from the taking lens 
that reaches the imaging camera. Preferably, the light controller comprises an iris. 
25 The 3D camera in an optical imaging system in accordance with some preferred 

embodiment of the present invention is a gated 3D camera. Preferably, the optical imaging 
system comprises a pulsed light source that radiates a train of Ught pulses to illuminate a scene 
being imaged with the optical imaging system. Preferably, the pulsed light source radiates IR 
Ught. 

30 According to some preferred embodiments of the present invention, the 3D camera 

comprises at least 2 photosurfaces. Preferably, the 3D camera comprises a light guide that 
receives light, from the taking lens system and directs portions of the light that it receives to 
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each of the at least two photosurfaces. Preferably, the 3D camera comprises a single shutter, 
which when gated open enables light from the taking lens system to reach the light guide. 

The optical imaging system preferably comprises a controller that gates the single 
shutter open and closed. Preferably, the controller controls each of the photosurfaces to be 
5 activated and deactivated and wherein when a photosurface is activated, it is sensitive to light 
incident thereon. Preferably, the controller gates on the single shutter it activates one and only 
one of the at least two photosurfaces. 

Preferably, the at least two photosurfaces comprises three photosurfaces. Preferably, 
following a time that at least one light pulse is radiated, the controller gates on the single 
10 shutter for a first gate and turns on a first photosurface and the first gate is timed so that light 
reflected firom the at least one light pulse by a region in the scene is registered by the first 
photosurface. 

Following a time that at least one light pulse in the train of light pulses is radiated, the 
controller preferably gates on the single shutter for a second gate and activates a second one of 
IS the photosurfaces and the second gate is timed so that during the second gate no light from the 
at least one light pulse reflected by the region is registered by the second photosurface. 

Prefeably, following a time that at least one light pulse in the train of light pulses is 
radiated the controller gates on the single shutter for a third gate and activates a third one of the 
photosurfaces and the controller controls the gate width and timing of the third gate so that 
20 during the third gate substantially all light fi-om the at least one pulse that is reflected by the 
region, which is collected by the taking lens system, is registered by the third photosurface. 

In some preferred embodiments of the present invention the light guide of the 3D 
camera is a three-way prism. 

Some optical imaging systems in accordance with preferred embodiments of the present 
25 invention comprise a beam splitter that receives light from the taking lens system and directs a 
portion of the received light towards the 3D camera and a portion of the received light to the 
imaging camera. 

In some preferred embodiments of the present invention the light guide of the 3D 
camera is a four- way prism that receives light from the taking lens system and directs a portion 
30 of the received light to the imaging camera. 

In some preferred embodiments of the present invention the imaging camera comprises 
a color camera. 
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In some optical imaging systems, in accordance with preferred embodiments of the 
present invention, the imaging camera is a color camera comprising separate R, G and B 
photosurfaces and the imaging system comprises a four way prism that receives light from the 
taking lens system and directs a portion of the received light to each of the R, G and B 
5 photosurfaces and to the single shutter of the 3D camera. 

There is further provided in accordance with a preferred embodiment of the present 
invention a gated 3D camera comprising: a taking lens system that collects light from a scene 
imaged with the 3D camera; at least 2 photosurfaces; a light guide that receives light from the 
taking lens and directs portions of the light that it receives to each of the at least two 
10 photosurfaces; and a single shutter, which when gated open enables light from the taking lens 
system to reach the light guide. 

Preferably, the controller controls each of the photosurfaces to be activated and 
deactivated and wherein when a photosurface is activated, it is sensitive to light incident 
thereon. Preferably, each time that the controller gates on the single shutter it activates one and 
15 only one of the at least two photosurfaces. Preferably, the at least two photosurfaces comprises 
three photosurfaces. 

The 3D camera preferably comprises a pulsed light source that radiates a train of light 
pulses to illuminate a scene being imaged with the 3D camera. Prefereably, following a time 
that at least one light pulse is radiated, the controller gates on the single shutter for a first gate 
20 and turns on a first photosurface and the first gate is timed so that light reflected from the at 
least one light pulse by a region in the scene is registered by the first photosurface. 

Preferably, following a time that at least one light pulse in the train of light pulses is 
radiated, the controller gates on the single shutter for a second gate and activates a second one 
of the photosurfaces and the second gate is timed so that during the second gate no light from 
25 the at least one light pulse reflected by the region is registered by the second photosurface. 

Preferably, following a time that at least one light pulse in the train of light pulses is 
radiated, the controller gates on the single shutter for a third gate and activates a third one of 
the photosurfaces and the controller controls the gate width and timing of the third gate so that 
during the third gate substantially all light from the at least one pulse that is reflected by the 
30 region, which is collected by the taking lens system, is registered by the third photosurface. 



The invention will be more clearly understood by reference to the following description 
of preferred embodiments thereof read in conjunction with the figures attached hereto. In the 
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figures, identical structures, elements or parts which appear in more than one figure are labeled 
with the same numeral in all the figures in which they appear. Dimensions of components and 
featiures shown in the figures are chosen for convenience and clarity of presentation and are not 
necessarily shown to scale. The figures are listed below. 
5 Fig. 1 schematically shows a 3D imager comprising a 3D module, in accordance with a 

preferred embodiment of the present invention; 

Fig. 2A schematically shows a 3D imager comprising a 3D module, in accordance with 
a preferred embodiment of the present invention; 

Fig. 2B shows a timing diagram for shuttering photosin-faces comprised in the 3D 
10 imager shown in Fig. 2 A, in accordance with a preferred embodiment of the present invention; 

Fig. 3 schematically shows a 3D imager comprising a 3D module, in accordance with a 
preferred embodiment of the present invention; and 

Fig. 4 schematically shows a 3D imager comprising a 3D module and color imager 
integrated in a single unit, in accordance with a preferred embodiment of the present invention. 
1 5 DETAILED DESCMPTION OF PREFERRED EMBODIMENTS 

Fig. 1 schematically shows a 3D imager 20 comprising a 3D module 22, in accordance 
with a preferred embodiment of the present invention, shown inside dashed boundary 24. 3D 
module 22 comprises a beam splitter 26, two refocusing lens systems 28 and 30, referred to as 
"refocusers" 28 and 30, and a 3D camera 32 having components shown inside a dashed 
20 boundary 34. 3D module 22 is coupled to a taking lens system 35 and an imaging camera 36, 
which is shown by way of example as a video camera. Preferably, video camera 36 is a color 
video camera. Taking lens 35 and video camera 36 may be any suitable taking lens and video 
camera, for example a CCD or CMOS camera, readily available on the commercial market. A 
pulsed light source 38 radiates pulse trains of, preferably IR light pulses, to illuminate scenes 
25 being imaged with 3D imager 20. 3D imager 20 is shown, by way of example, imaging a scene 
40 having two elephants 42 and 44. 

Visual light and IR light fi^om IR source 38 that is reflected firom scene 40 and collected 
by taking lens 35 is represented by large arrows 46. Collected light 46 is transmitted by taking 
lens 35 to beam splitter 26. Visual light, represented by arrows 48, in collected light 46, is 
30 transmitted by beam splitter 26 and enters refocuser 28. Refocuser 28 generally comprises a 
field lens 50, an iris 52 and a relay lens 54. Refocuser 28 is boresighted with taking lens 35 and 
preferably positioned so that an image of scene 40 formed by taking lens 35 from visual light 
48 is located substantially at the location of field lens 50. Light from field lens 50 passes 
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through iris 52 and continues towards relay lens 54, which transmits the light to video camera 
36. Video camera 36 is boresighted with refocuser 28 and taking lens 35. The amount of light 
received by video 36 from refocuser 28 is controlled by iris 52. Received visual light 48 is 
imaged by video 36 to form a picture of scene 40. 

TR light, represented by dashed arrows 60, in collected light 46 that is incident on beam 
splitter 26 is reflected by beam splitter 26 to refocuser 30, which is boresighted with taking lens 
35. Refocuser 30 is generally similar to refocuser 28 and preferably comprises a field lens 62, 
an iris 64 and a relay lens 66. Refocuser 30 is preferably positioned so that an image of scene 
40 fomied in IR light 60 by taking lens 35 is located at the location of field lens 62. Refocuser 
30 transmits IR light that it receives towards 3D camera 32 which is boresighted with refocuser 
30 and taking lens 35. The amount of IR light 60 transmitted by refocuser 30 to 3D camera 32 
is controlled by iris 64. 

Irises 52 and 64 are controllable independently of each other and therefore enable the 
amoxmts of IR and visual light reaching 3D camera 32 and video camera 36 respectively to be 
controlled independently of each other, in accordance with a preferred embodiment of the 
present invention. 3D imager 20 therefore can easily be adjusted to simultaneously optimize 
the amounts of IR light reaching 3D camera 32 and visual light reaching video camera 36 from 
taking lens 35 to provide simultaneous quahty depth maps and pictures of scene 40. 

It is to be noted that commercially available taking lenses are generally supplied with 
an iris and taking lens 35 is shown with an iris 67. In operation of 3D imager 20, iris 67 is 
preferably permanently set to maximum open and the amounts of light reaching 3D camera 32 
and video camera 36 are controlled by irises 64 and 32 respectively. However, in some 
preferred embodiments of the present invention iris 67 is used in place of one of irises 52 or 64. 
For example, generally a greater fraction of IR light collected by taking lens 35 is needed to 
produce a quality depth map of a scene than the fraction that is needed of visible light collected 
by taking lens 35 to provide a quality picture of the scene. As a result, iris 67 may conveniently 
be used in place of iris 64 to modulate IR light reaching 3D camera 32. 

3D camera 32 preferably comprises a three-way prism 68 and preferably three 
photosurfaces 71, 72 and 73. Three-way prism 68 receives IR light 60 transmitted from 
refocuser 30 and directs portions of the received IR light to each of photosxirfaces 71, 72 and 
73. Photosurfaces 71, 72 and 73 are respectively shuttered by fast shutters 81, 82 and 83. Fast 
shutters 81, 82 and 83, and fast shutters in other preferred embodiments of the present 
invention, are preferably either gated image intensifiers or fast solid state shutters of a type 
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described in above cited PCT patent application PCT/EL98/00060. In some preferred 
embodiments of the present invention in which 3D photosurfaces are shuttered individually by 
their own fast shutters, as are photosurfaces 71, 72 and 73, the shutters are comprised in the 
photosurfaces. Photosurfaces that comprise shuttering apparatus are described in PCT patent 
appUcation PCT/IL98/00476 cited above. A controller (not shown) controls shutters 81, 82 and 
83. 

Photosurfaces 71, 72 and 73 function respectively as a distance photosurface, a 
background photosurface and a normalization photosurface and are labeled accordingly "D", 
"N" and "B" in Fig 1. The choice of which photosurface 71, 72 or 73 is a distance, background 
or normalization photosurface is arbitrary and the choices shown in Fig. 1 are choices of 
convenience. The controller controls shutters 81, 82 and 83 to gate photosurfaces 71, 72 and 73 
following each IR pulse radiated by IR source 38 with a sequence of gates similar to prior art 
gate sequences used in gated 3D cameras. Prior art gating sequences are described in above 
cited references PCT Publications WO 97/01111, WO 97/01112, WO 97/01113, US Patent 
5,434,612 and PCT Application PCT/IL98/00476. 

Whereas, in the preceding paragraph it is implied that photosurfaces 71, 72 and 73 are 
similar or substantially identical, and this is generally the case, in some preferred embodiments 
of the present invention, different ones of the photosurfaces in 3D camera 32 are different. For 
example, a photosurface used to measure background light or normalization light may have a 
lower resolution than a resolution of a photosurface used as a distance photosurface and this 
can be advantageous. 

Shutter 81 is controlled to respectively gate distance photosm-face 71 with a relatively 
short gate and normalization photosurface 73 with a relatively long gate. Preferably the short 
gate has a gate width that is equal to the pulse width of IR pulses radiated by pulsed IR source 
38. Preferably the time centers of the short gates and long gates coincide. The controller 
preferably controls shutter 83 to gate background photosurface 72 with a short gate. The short 
gate of background photosurface 72 is timed to occur when no IR light from pulsed IR source 
38 that is reflected from scene 40 is incident on taking lens 35. Preferably the short gates of 
distance photosurface 71 and background photosurface 72 are equal. During the short gate of 
background photosurface 72, substantially only backgroimd light and dark current effects are 
registered by background photosurface 72. 

The amounts of light registered on pixels of distance photosurface 71, background 
photosurface 72 and normalization photosurface 73 are sensed and transmitted to a processor 
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(not shown) using methods known in the art and processed as in prior art to provide a depth 
map of scene 40. 

Photosurfaces comprised in 3D cameras and imaging cameras that are used in 3D 
imagers, in accordance with preferred embodiments of the present invention, are preferably 
homologous. Two photosurfaces are said to be homologous if there is a one to one mapping of 
regions of one of the photosurfaces onto the other and the positions of any two regions that 
map onto each other are similar in their respective photosurfaces. 

Fig. 2 shows another 3D imager 100 imaging scene 40. 3D imager 100 comprises a 3D 
module 102 optically coupled to taking lens 35 and video camera 36. 

3D module 102, having components shown inside dashed boundary 104, is similar to 
3D module 22. 3D module 102 comprises beam splitter 26 and refocuser 28 that transmits 
visual light 48 from taking lens 35 to video camera 36, which generates a picture of scene 40 
responsive to the visual light that it receives. 3D module 102 comprises a 3D camera 106 
having components shown inside dashed boundary 108. 

However, unlike 3D module 22, 3D module 22 does not comprise a refocuser 30 that 
irises and transmits IR light from beam splitter 26 to 3D camera 106. Instead, IR light 60 from 
beam splitter 26 passes through a fast shutter 110 and a relay lens 112 that directs the IR light 
to 3D camera 106. Preferably, an iris 111 controls the amount of light from taking lens 35 
transmitted to 3D camera 106. 3D camera 106 is similar to 3D camera. 32 shown in Fig. 1 and 
comprises a three-way prism 68 that directs portions of IR light 60 incident on three-way prism 
68 to a distance photosurface 121, a background photosurface 122 and a normalization 
photosurface 123. However, unlike photosurfaces 71, 72 and 73 in 3D camera 32, 
Photosurfaces 121, 122 and 123 are not individually gated by their own fast shutters as are 
photosurfaces 71, 72 and 73 in 3D camera 32. Fast gating for all photosurfaces 121, 122 and 
123 is done by fast shutter 110, which is common to all photosurfaces 121, 122 and 123. 
Photosurfaces 121, 122 and 123 are turned on and off to determine which photosurface 
registers light during a gate of fast shutter 110. Preferably, only one photosurface is turned on 
during a gate of fast shutter 110. 

Fast shutter 110 is controlled by a controller (not shown) to be gated open with a 
sequence of short and long gates in synchrony with IR pulses radiated by IR source 38. 
Preferably, two sequential short gates having a same gate width follow every other ER light 
pulse in a train of light pulses radiated by IR light source 38 to illuminate scene 40. Preferably, 
a long gate follows every IR pulse that is not followed by the two sequential short gates. 
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During the first short gate, IR light reflected from scene 40 is collected hy taking lens 
35 and transmitted to 3D camera 105 and only distance photosurface 121 is turned on. Only 
distance photosurface 121 registers amounts of Ught incident on 3D camera 106 during the first 
short gate. The amount of reflected IR light registered on distance photosurface 121 firom a 
region of scene 40, compared to the total amount of reflected IR light reaching taking lens 35 
from the region is useable to detemiine the distance of the region from 3D camera 106. 

The timing of the first short gate with respect to an IR light pulse from which reflected 
light is registered by distance photosurface 121 and the gate width of the short gate, detemiine 
a center for a range of distances for which 3D camera 106 can provide distance measurements 
to regions in scene 40. The width of the range is determined by the pulse width of the IR pulses 
and the gate width of the short gate. 

The second short gate is timed to occur when no IR light reflected from scene 40 
reaches taking lens 35. During the second short gate only background light is collected by 
taking lens 35 and transmitted to 3D camera 106. Only background photosurface 122 is turned 
on and registers light incident on 3D camera 106. Backgroxmd photosurface 106 exclusively 
acquires background light information from scene 40. 

The time centers of the long gates and the first short gates are preferably delayed by the 
same time with respect to their respective IR light pulses. During the long gates, only 
normalization photosurface 123 is turned on. Normalization photosurface 123 registers 
amounts of IR light that are responsive to total amounts of reflected IR light reaching taking 
lens 35 firom regions of scene 40. 

It should be noted that, while photosurfaces 121, 122 and 123 are turned on and off to 
gate 3D camera 106, gating of 3D camera 106 for accurate distance measurements cannot be 
accomplished without fast gate 110 and only by turning on and off photosurfaces 121, 122 and 
123. Accurate distance measurement require that photosurfaces 121, 122 and 123 be gated on 
and off in times on the order of nanoseconds or less. Photosurfaces such as CCD photosurfaces 
can generally be turned on and off in times on the order of microseconds. 

However, whereas turning photosurfaces on and off can not generally be used for fast 
shuttering of photosurfaces, it can be used for irising photosurfaces. For example, a 
photosurface in some video cameras can be turned off for a fraction of a firame time to control 
an amount of light that the photosurface registers. In some preferred embodiments of the 
present invention irising of an imaging camera is accomplished by controlling the length of 
time that a photosurface comprised in the imaging camera is on during a frame time. 
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As in prior art, amounts of light registered on pixels of distance photosurface 121 are 
corrected for background and normalized using amounts of light registered on corresponding 
pixels of on background photosurface 122 and normalization photosurface 123. The corrected 
and normalized amounts of light are used to determine distances to reflecting regions of scene 

5 40, in this case, by way of example distances to elephants 42 and 44. 

Fig. 2B shows, as function of time, a graph 130 of gates of fast shutter 110 and 
associated periods of time, hereinafter referred to as "on times" during which photosurfaces 
121, 122 and 123 are tumed on, in accordance with a preferred embodiment of the present 
invention. The gates and on times are shown by way of example synchronized with four IR 

10 pulses, represented by rectangles 131, 132, 133 and 134 on a time line 136, of a pulse train of 
IR pulses radiated by IR source 38 shown in Fig. 2 A to illuminate scene 40. The choice of four 
IR pulses in the train of pulses is by way of example only and is a choice of convenience. 

The gates of fast gate 1 10 are represented by dashed rectangles 141, 142 and 143. Gates 
141 are short "distance gates" and gates 142 are short "background gates". A distance gate 141 

15 and a background gate 142 follow every other IR pulse (the odd numbered IR pulses in Fig. 
2B) in the pulse train radiated by IR source 38. Gates 143 are long "normalization" gates that 
preferably follow every IR pulse (the even numbered IR pulses in Fig. 2B) that is not followed 
by a distance gate 141 and a background gate 142. 

The on times of distance, background and normalization photosurfaces 121, 122 and 

20 123 are shown as trapezoids 150 on timelines 151, 152 and 153 respectively. Distance 
photosurface 121 is on only during short distance gates 141. Background photosurface 122 is 
on only during short background gates 142 and normalization photosurface 123 is on only 
during long normalization gates 143. The sloped side edges of the trapezoids indicate the 
relatively long periods of time required to turn on and off a photosurface compared to the short 

25 tum-on and turn-off times required to gate photosurfaces quickly enough to provide accurate 
distance measurements. 

An intensity of light received by taking lens 35 from elephant 42 as a function of time is 
represented by the height of an "intensity" line 160 above a base line 162. Rectangular "peaks" 
164 in the height of intensity line 160 occur when IR light reflected from an IR pulse by 

30 elephant 42 reaches taking lens 35. The height of intensity line 160 outside of peaks 164 
represents background light received from elephant 42. Amounts of Ught received from 
elephant 42 that are registered by photosurfaces 121, 122 and 123 during gates 141, 142 and 
143 are represented by shaded areas 171, 172 and 173 respectively. 
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Similarly, an intensity of light received by taking lens 35 from second elephant 44 as a 
function of time is represented by the height of an intensity line 180, which has TR "reflection 
peaks" 184, above a base line 182. Shaded areas 181, 182, and 183 represent amounts of light 
from second elephant 44 registered by photosurfaces 121, 122 and 123 during gates 141, 142 
and 143 respectively. 

For elephant 42, background corrected Ught registered by distance photosurface 121 is 
represented by an area equal to the sum of the areas 171 minus the sum of areas 172. 
Background corrected light registered by normalization photosurface 123 is represented by an 
area equal to the sum of areas 173 minus the product of the ratio of the gate width of long gates 
143 to the gate width of short gates 142 times the sum of areas 173. For elephant 44, 
background corrected light registered by distance photosurface 121 is represented by an area 
equal to the sum of areas 181 minus the sum of areas 182. Background corrected light 
registered by normalization photosurface 123 for elephant 44 is represented by an area equal to 
the sum of areas 1 83 minus the product of the ratio of the gate width of long gates 143 to the 
gate width of short gates 142 times the sum of areas 183. 

Elephant 44 is further away from 3D imager 100 than elephant 42. As a result, the 
amount of background corrected light registered by distance photosurface 121 normalized to 
background collected light registered by normalization photosurface 123 is less for elephant 44 
than for elephant 42. 

Fig. 3 shows another 3D imager 200 imaging scene 40, in accordance with a preferred 
embodiment of the present invention. 

Imager 200 comprises a 3D module 202 having components shown inside dashed 
border 204, which is coupled to taking lens 35 and video camera 36. 3D module 202 comprises 
a 3D camera 206 having components shown inside dashed border 208. 3D camera 206 
comprises a four-way prism 210 that directs portions of IR Hght 60 in light 46 that is collected 
by taking lens 35 from scene 40 to distance, background and normalization photosurfaces 71, 
72 and 73 respectively. Each of photosurfaces 71, 72 and 73 is gated by its own fast shutter 81, 
82 and 83 respectively. Photosurfaces 71, 72 and 73 are gated similarly to the manner in which 
photosurfaces 71, 72 and 73 comprised in 3D camera 206, shown in Fig. 1, are gated. Amounts 
of IR light 60 collected by taking lens 35 that reaches 3D camera 206 is controlled by iris 67 
comprised in taking lens 35. 
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Four- way prism 210 also directs visual light 48 in light 46 collected by taking lens 35 to 
a refocuser 28 that preferably comprises a field lens 50 an iris 52 and a relay lens 54. Refocuser 
28 transmits visual light 48 that it receives fi-om four-way prism 210 to video camera 36. 

Fig. 4 schematically shows another 3D imager 220 imaging scene 40 in accordance 
with a prefenred embodiment of the present invention. 3D imager 220 comprises a unit 222, 
hereinafter referred to as a "combination unit", having components located within a border 224. 
Combination unit 222 comprises a 3D camera 226 having components shown inside a dashed 
boundary 228 and three color cameras, a Red (R) camera 230 a Green (G) camera 232 and a 
Blue (B) camera 234. Combination unit 222 is coupled to a taking lens 35, which is 
boresighted with 3D camera 226 and color cameras 230, 232 and 234. 

Combination unit 222 comprises a four-way prism 236 that directs visual light 48 
collected by taking lens 35 to each of color cameras 230, 232 and 234 and JR light 60 collected 
by taking lens 35 to a fast shutter 110 that shutters 3D camera 226. Preferably, combination 
unit 222 comprises an iris 1 1 1 that controls the amount of light 60 transmitted from taking lens 
35 to 3D camera 226. IR light 60 that fast shutter 110 transmits is incident on a relay lens 238 
that relays the light to a three-way prism 68, which directs portions of the IR light 60 that it 
receives to a distance photosurface 121, a background photosurface 122 and a normalization 
photosurface 123. 3D camera 226 is substantially the same as 3D camera 106 shown in Fig. 2 A 
and is gated by controlling fast shutter 110 and photo surfaces 121, 122, and 123 in the same 
manner in which 3D camera 106 is gated. 

Whereas combination unit 222 is shown comprising a 3D camera in which all the 
photosurfaces are shuttered by single shutter, in some preferred embodiments of the present 
invention, combination unit 222 comprises a 3D camera similar to 3D camera 32 shown in Fig. 
1 in which each photosurface of the 3D camera is shuttered by its own shutter. 

Combination unit 222 preferably comprises an adjustable neutral density filter 240 
located between taking lens 35 and four-way prism 236. Neutral density filter 240 is chosen so 
that it does not substantially attenuate IR Ught. Neutral density filter 240 is used to control the 
amount of visible light 48 collected by taking lens 35 that reaches color cameras 230, 232 and 
234. The amount of IR light 60 reaching 3D camera 226 is controlled by iris 67 comprised in 
taking lens 35. 

In the description and claims of the present application, each of the verbs, "comprise" 
"include" and "have", and conjugates thereof, are used to indicate that the object or objects of 
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the verb are not necessarily a complete listing of components, elements or parts of the subject 
or subjects of the verb. 

The present invention has been described using detailed descriptions of preferred 
embodiments thereof that are provided by way of example and are not intended to limit the 
scope of the invention. The described preferred embodiments comprise different features, not 
all of which are required in all embodiments of the invention. Some embodiments of the 
present invention utilize only some of the features or possible combinations of the features. 
Variations of embodiments of the present invention that are described and embodiments of the 
present invention comprising different combinations of features noted in the described 
embodiments will occur to persons of the art. The scope of the invention is limited only by the 
following claims. 
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CLAIMS 



1 . An optical imaging system comprising: 

a taking lens system that collects light from a scene being imaged with the optical 
5 imaging system; 

a 3D camera comprising at least one photosnrface that receives light from the taking 
lens system simultaneously from all points in the scene and provides data for generating a 
depth map of the scene responsive to the light; and 

an imaging camera comprising at least one photosurface that receives light from the 
10 taking lens system and provides a picture of the scene responsive to the light. 

2 An optical imaging system according to claim 1 wherein the 3D camera and the 
imaging camera are boresighted with the taking lens system. 

15 3. An optical imaging system according to claim 1 or claim 2 wherein the at least one 
photosurface of the 3D camera and the at least one photosurface of the imaging camera are 
homologous. 

4. An optical imaging system according to any of the preceding claims and comprising a 
20 light controller adjustable to control the amount of light from the taking lens system that 

reaches the imaging camera without affecting the amount of light from the taking lens system 
that reaches the 3D camera. 

5. An optical imaging system according to claim 4 wherein the light controller comprises 
25 an iris. 

6. An optical imaging system according to claim 4 wherein the light controller comprises 
a neutral density filter. 

30 7. An optical imaging system according to any of the preceding claims and comprising a 
light controller adjustable to control the amount of light collected by the taking lens system that 
enters the imaging system. 
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8. An optical imaging system according to claim 7 wherein the light controller that 
controls the amoimt of light collected by the taking lens system that enters the imaging system 
comprises an iris. 

5 9. An optical imaging system according to any of the preceding claims and comprising a 
light controller adjustable to control the amount of light from the taking lens system that 
reaches the 3D camera without affecting the amount of light from the taking lens that reaches 
the imaging camera. 

10 10. An optical imaging system according to claim 9 wherein the Ught controller that 
controls the amount of light from the taking lens system that reaches the 3D camera comprises 
an iris. 

11. An optical imaging system according to any of the preceding claims wherein the 3D 
1 5 camera is a gated 3D camera. 

12. An optical imaging system according to claim 1 1 and comprising a pulsed light source 
that radiates a train of light pulses to illuminate a scene being imaged with the optical imaging 
system. 

20 

13. An optical imaging system according to claim 12 wherein the pulsed light source 
radiates IR light. 

14. An optical imaging system according to any of claims 11-13 wherein the 3D camera 
25 comprises at least 2 photosurfaces. 

15. An optical imaging system according to claim 14 wherein the 3D camera comprises a 
light guide that receives light from the taking lens system and directs portions of the light that 
it receives to each of the at least two photosurfaces. 

30 

16. An optical imaging system according to claim 15 and comprising a single shutter, 
which when gated open enables light from the taking lens system to reach the light guide. 
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17. An optical imaging system according to claim 16 and comprising a controller that gates 
the single shutter open and closed. 

18. An optical imaging system according to claim 17 wherein the controller controls each 
of the photosurfaces to be activated and deactivated and wherein when a photosurface is 
activated, it is sensitive to light incident thereon. 

19. An optical imaging system according to claim 18 wherein each time that the controller 
gates on the single shutter it activates one and only one of the at least two photosurfaces. 

20. An optical imaging system according to claim 19 wherein the at least two photosurfaces 
comprises three photosurfaces. 

21. An optical imaging system according to claim 20 wherein following a time that at least 
one light pulse is radiated, the controller gates on the single shutter for a first gate and tums on 
a first photosurface and wherein the first gate is timed so that light reflected from the at least 
one light pulse by a region in the scene is registered by the first photosurface. 

22. An optical imaging system according to claim 21 wherein following a time that at least 
one light pulse in the train of light pulses is radiated, the controller gates on the single shutter 
for a second gate and activates a second one of the photosurfaces and wherein the second gate 
is timed so that during the second gate no light from the at least one light pulse reflected by the 
region is registered by the second photosurface. 

23. An optical imaging system according to claim 22 wherein following a time that at least 
one light pulse in the train of light pulses is radiated the controller gates on the single shutter 
for a third gate and activates a third one of the photosurfaces and wherein the controller 
controls the gate width and timing of the third gate so that during the third gate substantially all 
light from the at least one pulse that is reflected by the region, which is collected by the taking 
lens system, is registered by the third photosurface. 

24. An optical imaging system according to any of claims 15 -23 wherein the light guide is 
a three-way prism. 
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25. An optical imaging system according to any of claims 1-24 and comprising a beam 
splitter that receives light firom the taking lens system and directs a portion of the received light 
towards the 3D camera and a portion of the received light to the imaging camera. 

5 26. An optical imaging system according to any of claims 7-23 wherein the Ught guide is a 
four-way prism that receives light from the taking lens system and directs a portion of the 
received light to the imaging camera. 

27. An optical imaging system according to any of the preceding claims wherein the 
1 0 imaging camera comprises a color camera. 

28. An optical imaging system according to any of claims 1-24 wherein the imaging 
camera is a color camera comprising separate G and B photosurfaces and comprising a four 
way prism that receives light from the taking lens system and directs a portion of the received 

1 S light to each of the R, G and B photosurfaces and to the single shutter of the 3D camera. 



29. A gated 3D camera comprising: 

a taking lens system that collects light from a scene imaged with the 3D camera; 
at least 2 photosurfaces; 

20 a light guide that receives light from the taking lens and directs portions of the light that 

it receives to each of the at least two photosurfaces; and 

a single shutter, which when gated open enables light from the taking lens system to 
reach the light guide. 

25 30. A 3D camera according to claim 29 wherein the controller controls each of the 
photosurfaces to be activated and deactivated and wherein when a photosurface is activated, it 
is sensitive to light incident thereon. 

31. A 3D camera according to claim 30 wherein each time that the controller gates on the 
30 single shutter it activates one and only one of the at least two photosurfaces. 

32, A 3D camera according to claim 31 wherein the at least two photosurfaces comprises 
three photosurfaces. 
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33. A 3D camera according to claim 32 and comprising a pulsed light source that radiates a 
train of light pulses to illuminate a scene being imaged with the 3D camera. 

34. A 3D camera according to claim 33 wherein following a time that at least one light 
5 pulse is radiated, the controller gates on the single shutter for a first gate and turns on a first 

photosurface and wherein the first gate is timed so that light reflected from the at least one light 
pulse by a region in the scene is registered by the first photosurface. 

35. A 3D camera according to claim 34 wherein following a time that at least one light 
10 pulse in the train of light pulses is radiated, the controller gates on the single shutter for a 

second gate and activates a second one of the photosurfaces and wherein the second gate is 
timed so that during the second gate no light from the at least one light pulse reflected by the 
region is registered by the second photosurface. 

15 36. A 3D camera according to claim 35 wherein following a time that at least one light 
pulse in the train of light pulses is radiated the controller gates on the single shutter for a third 
gate and activates a third one of the photosurfaces and wherein the controller controls the gate 
width and timing of the third gate so that during the third gate substantially all light from the at 
least one pulse that is reflected by the region, which is collected by the taking lens system, is 

20 registered by the third photosurface. 
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CLAIMS 



1 . An optical imaging system comprising: 

a taking lens system that collects light from a scene being imaged with the optical 
5 imaging system; 

a 3D camera comprising at least one photosurface that receives light from the taking 
lens system simultaneously from all points in the scene and provides data for generating a 
depth map of the scene responsive to the light; and 

an imaging camera comprising at least one photosurface that receives light from the 
10 taking lens system and provides a picture of the scene responsive to the light. 

2 An optical imaging system according to claim 1 wherein the 3D camera and the 
imaging camera are boresighted with the taking lens system. 

15 3. An optical imaging system according to claim 1 or claim 2 wherein the at least one 
photosurface of the 3D camera and the at least one photosurface of the imaging camera are 
homologous. 

4. An optical imaging system according to any of the preceding claims and comprising a 
20 light controller adjustable to control the amount of light from the taking lens system that 

reaches the imaging camera without affecting the amount of light from the taking lens system 
that reaches the 3D camera, 

5. An optical imaging system according to claim 4 wherein the light controller comprises 
25 an iris. 

6. An optical imaging system according to claim 4 wherein the light controller comprises 
a neutral density filter. 

30 7. An optical imaging system according to any of the preceding claims and comprising a 
hght controller adjustable to control the amount of light collected by the taking lens system that 
enters the imaging system. 
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8. An optical imaging system according to claim 7 wherein the light controller that 
controls the amount of light collected by the taking lens system that enters the imaging system 
comprises an iris. 

5 9. An optical imaging system according to any of the preceding claims and comprising a 
light controller adjustable to control the amoimt of light from the taking lens system that 
reaches the 3D camera without affecting the amount of light from the taking lens that reaches 
the imaging camera. 

10 10. An optical imaging system according to claim 9 wherein the light controller that 
controls the amount of light from the taking lens system that reaches the 3D camera comprises 
an iris. 

11. An optical imaging system according to any of the preceding claims wherein the 3D 
1 5 camera is a gated 3D camera. 

12. An optical imaging system according to claim 1 1 and comprising a pulsed light source 
that radiates a train of light pulses to illuminate a scene being imaged with the optical imaging 
system, 

20 

13. An optical imaging system according to claim 12 wherein the pulsed ligln source 
radiates IR light. 

14. An optical imaging system according to any of claims 11-13 wherein the 3D camera 
25 comprises at least 2 photosiu-faces. 

15. An optical imaging system according to claim 14 wherein the 3D camera comprises a 
light guide that receives light from the taking lens system and directs portions of the light thai 
it receives to each of the at least two photosurfaces. 

30 

16. An optical imaging system according to claim 15 and comprising a single shutter, 
which when gated open enables light from the taking lens system to reach the light guide. 
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17. An optical imaging system according to claim 16 and comprising a controller that gates 
the single shutter open and closed. 



18. An optical imaging system according to claim 17 wherein the controller controls each 
5 of the photosurfaces to be activated and deactivated and wherein when a photosurface is 

activated, it is sensitive to light incident thereon. 

19. An optical imaging system according to claim 18 wherein each time that the controller 
gates on the single shutter it activates one and only one of the at least two photosurfaces. 

10 

20. An optical imaging system according to claim 19 wherein the at least two photosurfaces 
comprises three photosurfaces. 

21 . An optical imaging system according to claim 20 wherein following a time that at least 
15 one light pulse is radiated, the controller gates on the single shutter for a first gate and turns on 

a first photosurface and wherein the first gate is timed so that light reflected from the at least 
one light pulse by a region in the scene is registered by the first photosurface. 

22. An optical imaging system according to claim 21 wherein following a time that at least 
20 one light pulse in the train of light pulses is radiated, the controller gates on the single shutter 

for a second gate and activates a second one of the photosurfaces and wherein the second gate 
is timed so that during the second gate no light from the at least one light pulse reflected by the 
region is registered by the second photosurface. 

25 23. An optical imaging system according to claim 22 wherein following a time that at least 
one light pulse in the train of light pulses is radiated the controller gates on the single shutter 
for a third gate and activates a third one of the photosurfaces and wherein the controller 
controls the gate width and timing of the third gate so that during the third gate substantially all 
light from the at least one pulse that is reflected by the region, which is collected by the taking 

30 lens system, is registered by the third photosurface. 

24. An optical imaging system according to any of claims 15 -23 wherein the light guide is 
a three-way prism. 
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25. An optical imaging system according to any of claims 1-24 and comprising a beam 
splitter that receives light from the taking lens system and directs a portion of the received light 
towards the 3D camera and a portion of the received light to the imaging camera. 

5 26. An optical imaging system according to any of claims 7 - 23 wherein the hght guide is a 
four-way prism that receives light from the taking lens system and directs a portion of the 
received hght to the imaging camera. 

27. An optical imaging system according to any of the preceding claims wherein the 
1 0 imaging camera comprises a color camera. 

28. An optical imaging system according to any of claims 1 - 24 wherein the imaging 
camera is a color camera comprising separate R, G and B photosurfaces and comprising a four 
way prism that receives light from the taking lens system and directs a portion of the received 

1 5 light to each of the R, G and B photosurfaces and to the single shutter of the 3D camera. 

29. A gated 3D camera comprising: 

a taking lens system that collects light from a scene imaged with the 3D camera; 
at least 2 photosurfaces; 

20 a light guide that receives light from the taking lens and directs portions of tlie light that 

it receives to each of the at least two photosurfaces; and 

a single shutter, which when gated open enables light from the taking lens system to 
reach the light guide. 

25 30. A 3D camera according to claim 29 wherein the controller controls each of the 
photosurfaces to be activated and deactivated and wherein when a photosurface is activated, it 
is sensitive to Uglit incident thereon. 

31. A 3D camera according to clann 30 wherein each time that the controller gates on the 
30 single shutter it activates one and only one of the at least two photosurfaces, 

32. A 3D camera according to claim 31 wherein the at least two photosurfaces comprises 
three photosurfaces. 
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33. A 3D camera according to claim 32 and comprising a pulsed light source that radiates a 
train of light pulses to illuminate a scene being imaged with the 3D camera. 

34. A 3D camera according to claim 33 wherein following a time that at least one light 
5 pulse is radiated, the controller gates on the single shutter for a first gate and turns on a first 

photosurface and wherein the first gate is timed so that light reflected fi-om the at least one light 
pulse by a region in the scene is registered by the first photosurface. 

35. A 3D camera according to claim 34 wherein following a time that at least one hght 
10 pulse in the train of light pulses is radiated, the controller gates on the single shutter for a 

second gate and activates a second one of the photosurfaces and wherein the second gate is 
timed so that during the second gate no light from the at least one light pulse reflected by the 
region is registered by the second photosurface. 

15 36. A 3D camera according to claim 35 wherein following a time that at least one light 
pulse in the train of light pulses is radiated the controller gates on the single shutter for a third 
gate and activates a third one of the photosurfaces and wherein the controller controls the gate 
width and timing of the third gate so that during the third gate substantially all light from the at 
least one pulse that is reflected by the region, which is collected by the taking lens system, is 

20 registered by the third photosurface. 
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